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DETAILED ACTION 

Prosecution History 

On 21 December 2001, applicant filed the instant application. Applicant claims 
priority to provisional application 60/325559, filed 1 October 2001. 

On 3 April 2003, the application was published as PG-PUB 20030065578 . 

On 1 April 2005, the Examiner issued an election/restriction requirement. 

On 2 May 2005, applicant elected claims 1 , 2, 18-20 with traverse. 

On 14 July 2005, the Examiner issued a non-final rejection of claims 1-2 as 
anticipated by Voticky et al. (US 6801216), and claims 18-20 as unpatentable over 
Voticky in view of Orpaz (US PG-PUB 2002/0071604). 

After further consideration and based upon counsel's persuasive arguments in a 
phone interview of 30 October 2005, the Examiner vacates the Election/Restriction 
requirement of 1 April 2005 as well as the non-final Office Action of 14 July 2005. 

Claims 1-72 will be examined. Claims 1, 22, 36, 55, 68 and 72 are independent. 
The various groups are treated as variants of the invention. 

Priority 

This application claims benefit to provisional application 60/325559: 

Artificial Intelligence For Use In Cosmetic And Non-Cosmetic Environments, Application 
No. 60/325,561 (provisional filed Oct. 1, 2001); and Methods And Systems For Cosmetic 
And Non-Cosmetic Product Selection, Application No. 60/325,559 (provisional filed Oct. 
1,2001). 

Provisional application 60/325559 lists inventors: Giacchetti, Rubinstenn, Pruche, 
and Peyrelevade. 
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It is not clear whether Applicant also claims priority from provisional application 
60/325561 , filed 1 October 2001 , with Olivier de la Charriere the only named inventor. 

The instant non-provisional application lists Peyrelevade and Naudin. 

Applicant is requested to identify where in the prior applications the features of 
the present invention are first disclosed. Since the provisional applications also list 
different inventors than the present application (and with different inventors), the 
examiner also requests the Applicant identify which inventor(s) contributed which 
features claimed in the present application that were also present in one or more prior 
application with different inventors. 

Claim Objections 

Regarding claims 36 and 44, the phrase "means for" appears to be an attempt to 
invoke 35 U.S.C. 112, sixth paragraph, to recite claim element as a means for 
performing a specified function. However, since the disclosures provide no structural 
support for the claims, it is impossible to determine the equivalents of the element, as 
required by 35 U.S.C. 112, sixth paragraph. See Ex parte Klumb, 159 USPQ 694 (Bd. 
App. 1967). 

purposes of this examination, the claim will be interpreted to not invoke the sixth 
paragraph. Prior art will be interpreted to read on applicant's claimed limitations where 
prior art discloses that the functions are being performed. 



Claim Rejections - 35 USC §112 
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The following is a quotation of the first paragraph of 35 U.S.C. 112: 

The specification shall contain a written description of the invention, and of the manner and process of 
making and using it, in such full, clear, concise, and exact terms as to enable any person skilled in the 
art to which it pertains, or with which it is most nearly connected, to make and use the same and shall 
set forth the best mode contemplated by the inventor of carrying out his invention. 

Claims 23, 24, 56, 57 are rejected under 35 U.S.C. 112, first paragraph, as failing 
to comply with the enablement requirement . The claim(s) contains subject matter which 
was not described in the specification in such a way as to enable one skilled in the art to 
which it pertains, or with which it is most nearly connected, to make and/or use the 
invention. 

Claims 23, 24, 56, 57 refer to artificial intelligence, which is only briefly 

mentioned, without elaboration, in the disclosures of the instant application and in the 

provisional applications: 

[0045] "Artificial intelligence" is used herein to broadly describe any computationally 
intelligent systems that combine knowledge, techniques, and methodologies. An Al 
engine may be any system configured to apply knowledge and that can adapt itself and 
learn to do better in changing environments. Thus, the Al engine may employ any one or 
combination of the following computational techniques: neural network, constraint 
program, fuzzy logic, classification, conventional artificial intelligence, symbolic 
manipulation, fuzzy set theory, evolutionary computation, cybernetics, data mining, 
approximate reasoning, derivative-free optimization, decision trees, and/or soft 
computing. Employing any computationally intelligent techniques, the Al engine may 
learn to adapt to unknown and/or changing environment for better performance. 

Claims 23, 24, 56 and 57 are rejected under 35 U.S.C. 112, first paragraph, as 
failing to comply with the written description requirement. The claim(s) contains subject 
matter which was not described in the specification in such a way as to reasonably 
convey to one skilled in the relevant art that the inventor(s), at the time the application 
was filed, had possession of the claimed invention. 
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Claim Rejections - 35 USC § 102 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

Claims 1-10. 13-17. 21-22. 25. 27-44. 47-55. 58. 60-72 are rejected under 35 - 
U.S.C. 102(e) as being anticipated by Voticky et al. (US 6801216). 

As per claim 1, Voticky discloses selecting beauty products, including: 

accessing a facial image. See, for example, references to various picture 
images, as in Fig. 9 and related text. 

receiving from the user a selection of at least one beauty product for simulated 
application to the facial image. See, for example, at least Fig. 10 and related text, 
concerning selection references 222 and 224. 

simulating the at least one selected beauty product on the facial image. See, for 
example, at least Fig. 9 and references to overlays, as in an "After picture." 

determining a recommended beauty product based at least in part on the at least 
one selected product. See, for example, at least Col. 1 1 , lines 26-53, concerning 
product suggestions and recommendations. 

simulating the at least one recommended beauty product on the facial image. 
See, for example, at least Fig. 9, overlay images, "after picture". 

As per claim 2, Voticky discloses causing the facial image to be displayed to the 
user. See, for example, at least Fig. 9 and related text. 
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As per claim 3, Voticky discloses that the recommended beauty product is 
simulated on the facial image while the simulation of the at least one selected product 
appears on the facial image. See, for example, at least Col. 1 1 , lines 26-37. 

As per claim 4, Voticky discloses that causing the facial image to be displayed 
includes providing software that facilitates display of the facial image. See, for example, 
at least Col. 1, lines 18-42. 

As per claim 5, Voticky discloses that the facial image is an image of the user's 
face. See, for example, references to picture of a person, as in Col. 1 , lines 33-51 . 

As per claim 6, Voticky discloses processing an initial facial image in a manner 
to thereafter permit simulated application of a beauty product to a selected portion of the 
facial image. See, for example, at least Col. 1 1 , lines 6-20, which allows for selective 
application to various portions of the image. 

As per claim 7, Voticky discloses receiving from the user an affirmative request 
seeking a recommendation, and wherein the simulation of the recommended product 
appears on the facial image after the user affirmatively seeks a recommendation. See, 
for example, at least Col. 1 1 , lines 26-37. 

As per claim 8, Voticky discloses that the request identifies at least one of a 
brand, price, store, and product characteristic. See, for example, at least Col. 10, lines 
8-16 and references to selection of product lines. See also references to manufacturer, 
as in Col. 11, lines 28-53. 

As per claim 9, Voticky discloses displaying a button activatable to cause a 
recommendation to be displayed. See, for example, at least Col. 3, lines 32-40. 



Application/Control Number: 10/024,355 Page 7 

Art Unit: 3625 

As per claim 10, Voticky discloses sequentially simulating alternative 
recommendations. See, for example, at least Col. 9, lines 16-29. 
For claims 11-12. see 103 rejection. 

As per claim 13, Voticky discloses that the recommended product is 
complementary to the selected product, and maintaining a data structure identifying 
products, and wherein determining a recommended beauty product is accomplished by 
accessing the data structure. See, for example, at least Col. 8, line 61 -Col. 9, line 14. 

As per claim 14, Voticky discloses that the data structure is populated with 
information derived from at least one of advice of beauty experts, user preference data, 
user purchase history, and survey data. See, for example, references to professional 
version, as in Fig. 4. 

As per claim 15, Voticky discloses eliciting personal information from the user, 
wherein the recommendation is a function of both at least one selected product and the 
personal information, (see at least references to a user's face, as in Col. 7, lines 21-30). 

As per claim 16, Voticky discloses that personal information includes at least 
one of age, skin type, skin texture, skin tone, wrinkles, hair color, hair style, hair 
condition, eye color, allergies, facial features, demographics, user preferences, and 
purchase history. (See, for example, at least Col.1 , lines 33-51). 

As per claim 17, Voticky discloses providing the user with an ability to select a 
basis for a recommendation, the basis being at least one of consumer survey data, 
consumer buying preferences, and expert advice (See, for example, Fig.4 and related 
text, concerning professional and customer versions). 
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For Claims 18-20 . see 103 rejection. 

As per claim 21, Voticky discloses a network environment, wherein accessing 
the facial image and receiving the user selection occur via a network and in at least one 
location remote from a location of the user. See, for example, at least Fig. 1 and related 
text concerning network. 

Claim 22, an independent claim, is rejected on the same grounds as claim 1. 

For Claims 23-24. see rejection under 103 

As per claim 25, Voticky discloses providing the user with an option to trigger a 
simulation includes providing the user with an option to trigger a simulation of both the 
selected beauty product and the complementary beauty product. See at least 
references to selecting pictures, as in Col. 2, lines 17-40. 

For Claim 26 see 103 rejection, below. 

Claim 27 is rejected on the same grounds as claim 10. 

As per claim 28, Voticky discloses providing the user with an option to change a 
color of the selected beauty product. See, for example, at least Col 10, lines 8-24. 

As per claim 29, Voticky discloses providing users with options to change a 
color of complementary beauty product. See, for example, at least Col 10, lines 8-24. 

As per claim 30, Voticky discloses that the option to change the color is based 
on at least one of a color bar, color palette, progressive color adjuster, and textual entry. 
See, for example, at least Col. 10, lines 8-24. 
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As per claim 31, Voticky discloses that the facial image includes at least one of 
a photograph, simulation, and graphical representation. See, for example, at least Fig. 
10 and related text, and other references to graphic layers and picture. 

Claim 32 is rejected on the same grounds as claim 21 . 

As per claim 33, Voticky discloses receiving a request from the user for an 
alternative complementary product recommendation. See at least Col. 8, lines 5-14. 

Claim 34 is rejected on the same grounds as claim 22. 

As per claim 35, Voticky discloses providing the user with an option to change a 
color of at least one of the selected beauty product, the recommended complementary 
beauty product, and the alternative complementary product. See, for example, at least 
Col 10, lines 8-24. 

Claim 36, an Independent claim, is rejected on the same grounds as claim 1. 

Claim 37 is rejected on the same grounds as claim 3. 

Claim 38 is rejected on the same grounds as claim 4. 

Claim 39 is rejected on the same grounds as claim 5. 

Claim 40 is rejected on the same grounds as claim 6. 

Claim 41 is rejected on the same grounds as claim 7. 

Claim 42 is rejected on the same grounds as claim 8. 

Claim 43 is rejected on the same grounds as claim 9. 

Claim 44 is rejected on the same grounds as claim 10. 

For claims 45-46 . see 103 rejection. 

Claim 47 is rejected on the same grounds as claim 13. 
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Claim 48 is rejected on the same grounds as claim 14. 

Claim 49 is rejected on the same grounds as claim 15. 

Claim 50 is rejected on the same grounds as claim 16. 

Claim 51 is rejected on the same grounds as claim 17. 

As per claim 52, Voticky discloses that the display presents two facial images, 
and wherein differing recommended products are displayed on each image. See at 
least Col. 8,lines 4-23. 

As per claim 53, Voticky discloses that multiple facial images are simultaneously 
displayed. For example, Col. 8, lines 4-23. 

As per claim 54, Voticky discloses that the simulator visually simulates a 
differing combination of beauty products on each facial image. See, for example, at 
least Col. 8,line 61 -Col. 9, line 28. 

Claim 55, an independent claim, is rejected on the same grounds as claim 1 . 

For Claims 56-57. see 103 rejection, below. 

Claim 58 is rejected on the same grounds as claims 22 and 25. 

For Claim 59. s ee 103 rejection, below. 

Claim 60 is rejected on the same grounds as claim 27. 

Claim 61 is rejected on the same grounds as claim 28. 

Claim 62 is rejected on the same grounds as claim 29. 

Claim 63 is rejected on the same grounds as claim 30. 

Claim 64 is rejected on the same grounds as claim 31 . 

Claim 65 is rejected on the same grounds as claim 33. 
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Claim 66 is rejected on the same grounds as claim 35. 

As per claim 67, Voticky discloses a storage location for storing the facial image. 
See, for example, at least Fig. 2 and related text. 

Claim 68, an independent claim, is rejected on the same grounds as claim 1 . 

As per claim 69, Voticky discloses that the personal information includes an 
image of the user on which the simulating occurs. See, for example, at least Fig. 10 
and related text, and other references to graphic layers and picture. 

As per claim 70, Voticky discloses processing the image of the user to 
determine facial characteristics, and wherein determining takes into account the facial 
characteristics. See, for example, at last Col. 1 1 , lines 21-25. 

Claim 71 is rejected on the same grounds as claim 21 . 

Claim 72 is rejected on the same grounds as claim 1 . 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 11-12, 18-20, 26, 45. 46, 59 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Voticky, above, in view of Orpaz et al. (US 6937755). 

As per claim 11, Voticky discloses causing the facial image to be displayed to 
the user (See, for example, at least Fig. 12 and related text). Voticky does not 
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specifically disclose that a first alternative simulated recommendation is displayed 
simultaneously on the facial image with a display of the at least one selected product, 
and wherein thereafter a second alternative simulated recommendation is displayed 
simultaneously on the facial image with a display of the at least one selected product. 

This feature is disclosed by Orpaz, Fig. 4 and related text, as in Col. 4, lines 37- 
50. It would have been obvious to one of ordinary skill in the art at the time the 
invention was made to combine Voticky and Orpaz to disclose that a first alternative 
simulated recommendation is displayed simultaneously on the facial image with a 
display of the at least one selected product, and wherein thereafter a second alternative 
simulated recommendation is displayed simultaneously on the facial image with a 
display of the at least one selected product. 

One of ordinary skill in the art at the time the invention was made would have 
been motivated to combine Voticky and Orpaz to disclose that a first alternative 
simulated recommendation is displayed simultaneously on the facial image with a 
display of the at least one selected product, and wherein thereafter a second alternative 
simulated recommendation is displayed simultaneously on the facial image with a 
display of the at least one selected product for the obvious reason that a customer may 
wish to view various looks at the same time. 

Claim 12 is rejected on the same grounds as claim 1 1 . 

Claim 18 is rejected on the same grounds as claim 1 1 . 

Claim 19 is rejected on the same grounds as claim 1 1 . 
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As per claim 20, Voticky discloses that each facial image has a differing 
combination of beauty products simulated thereon. See, for example, at least Col. 8, 
line 61 - Col. 9, line 15). 

Claim 26 is rejected on the same grounds as claim 1 1 . 

Claim 45 is rejected oh the same grounds as claim 1 1 . 

Claim 46 is rejected on the same grounds as claim 12. 

Claim 59 is rejected on the same grounds as claim 1 1 . 

Claims 23-24. 56-57 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Voticky, Orpaz and Official Notice. 

Wicky and Orpaz do not specifically disclose the use of Artificial Intelligence. 

Official Notice is taken that it was old and well know at the time the invention was 
made to analyze historical data to provide guidance concerning consumer preferences. 

It would have been obvious to one of ordinary skill at the time the invention was 
made to combine Voticky, Orpaz and knowledge of one of ordinary skill to disclose 
identifying a complementary product is performed using an artificial intelligence engine 
(as in claims 23 and 56) and to disclose .that the artificial intelligence engine is based 
on at least one of a neural network, constraint program, fuzzy logic, classification, 
conventional artificial intelligence, symbolic manipulation, fuzzy set theory, evolutionary 
computation, cybernetics, data mining, approximate reasoning, derivative-free 
optimization, and soft computing (claims 24 and 57). 
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One of ordinary skill at the time the invention was made would have been 
motivated to combine Voticky, Orpaz and knowledge of one of ordinary skill to disclose 
identifying a complementary product is performed using an artificial intelligence engine 
(as in claims 23 and 56) and to disclose .that the artificial intelligence engine is based 
on at least one of a neural network, constraint program, fuzzy logic, classification, 
conventional artificial intelligence, symbolic manipulation, fuzzy set theory, evolutionary 
computation, cybernetics, data mining, approximate reasoning, derivative-free 
optimization, and soft computing (claims 24 and 57) for the obvious reason that by 
having information concerning consumer preferences, a company is better able to serve 
the public, and be able to provide a powerful and persuasive marketing tool. 

Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

David Pollitt, "Logistics management at the threshold of the new millenium" 
International Journal of Physical Distribution & Logistics Management . Bradford: 1998 . 
Vol. 28, Iss. 3; pg. 167, 40 pages. 

Gael Fashinabauer Cooper . Tips on buying beauty products online; [METRO 
Edition], . Star Tribune . Minneapolis, Minn.: Nov 22. 1999 . pg. OLE, 4 pages. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to James H. Zurita whose telephone number is 571-272- 
6766. The examiner can normally be reached on 8a-5pm. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Jeffrey A. Smith can be reached on 571-272-6763. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 



Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
James Zurita 
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